Multi-Scale Control Signal-Aware Transformer for Motion Synthesis without Phase
نویسندگان
چکیده
Synthesizing controllable motion for a character using deep learning has been promising approach due to its potential learn compact model without laborious feature engineering. To produce dynamic from weak control signals such as desired paths, existing methods often require auxiliary information phases alleviating ambiguity, which limits their generalisation capability. As past poses contain useful hints, in this paper, we propose task-agnostic method, namely Multi-scale Control Signal-aware Transformer (MCS-T), with an attention based encoder-decoder architecture discover the implicitly synthesizing explicitly requiring phase. Specifically, encoder is devised adaptively formulate patterns of character's multi-scale skeletons, and decoder driven by further synthesize predict state paying context-specialised encoded patterns. result, it helps alleviate issues low responsiveness slow transition happen conventional not information. Both qualitative quantitative experimental results on biped locomotion dataset, involves diverse types transitions, demonstrate effectiveness our method. In particular, MCS-T able successfully generate motions comparable those generated
منابع مشابه
Flexible Power Electronic Transformer for Power Flow Control Applications
This paper proposes a Flexible Power Electronic Transformer (FPET) for the application in the micro-grids. The low frequency transformer is usually used at the Point of Common Coupling (PCC) to connect the low voltage grid and utility network to each other. The conventional 50Hz transformer results in enhanced low voltage-grid power management system during grid-connected operation. In this pap...
متن کاملOptimum signal synthesis for time-scale estimation
In signal analysis, the joint estimation of the time-scale parameters which can affect a known signal (Doppler effect or scale effect, delay. . . ) may be a problem of interest. An important result has shown that, even if the quality of the time delay estimation is classically given by the inverse spread of the signal spectral density, the quality of the scale estimation only depends on the inv...
متن کاملPhase-Aware Signal Processing for Automatic Speech Recognition
Conventional automatic speech recognition (ASR) often neglects the spectral phase information in its front-end and feature extraction stages. The aim of this paper is to show the impact that enhancement of the noisy spectral phase has on ASR accuracy when dealing with speech signals corrupted with additive noise. Apart from proof-of-concept experiments using clean spectral phase, we also presen...
متن کاملSynthesis and Control on Large Scale Multi-Touch Sensing Displays
In this paper, we describe our experience in musical interface design for a large scale, high-resolution, multi-touch display surface. We provide an overview of historical and presentday context in multi-touch audio interaction, and describe our approach to analysis of tracked multi-nger, multi-hand data for controlling live audio synthesis.
متن کاملMulti-skilled Motion Control
Deep reinforcement learning has demonstrated increasing capabilities for continuous control problems, including agents that can move with skill and agility through their environment. An open problem in this setting is that of developing good strategies for integrating or merging policies for multiple skills, where each individual skill is a specialist in a specific skill and its associated stat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i5.25752